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SURFACE MAPPING ARRANGEMENT AND METHOD 



This invention relates to surface mapping arrangements and 
methods, and it relates more particularly to such arrangements 
5 and methods for permitting the capture of selected, parameters 
relating to an environment comprising one or more surfaces, 
for the purpose of enabling the appearance of a representation 
of at least one surface in the environment to be changed under 
user control. 

10 

It is known that the appearance of representations of 
surfaces, such as wall, ceiling and/or floor surfaces, in an 
environment such as a room of a domestic dwelling, can be 
changed under user control by means of software applied 'to a 

15 computer which is furnished with a digital image of the room. 
The image may be, for example, derived from a photograph of 
the room, or a chosen area of it. The photograph may be taken 
on a digital camera, enabling direct input to the computer, 
or it may be a conventional photograph which is scanned into 

20 the computer to provide the digital image. - 

In order to enable a user of the computer to conveniently and 
accurately apply different surface patterns, textures and/or 
colouration to the surfaces in question, the software requires 
25 the user to input certain critical parameters which define 
important physical characteristics of the surface or surfaces 
in question- This mapping operation is difficult and time 
consuming and in practice deters many people from using the 
software. 



30 



This invention aims , to provide an improved mapping 
arrangement, thereby to reduce the time and effort needed to 
input these critical data. 
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According to the invention from one aspect there is provided 
a mapping arrangement for defining selected physical 
characteristics of a surface to be imaged^ the arrangement 
comprising a template device for temporary application to said 
5 surface; said template device being configured and constructed 
such that;, when photographed in situ on said surface, it 
provides a computer supplied with a digital image of the 
photograph with data from which one or more of said physical 
characteristics can be automatically computed, thereby 
10 permitting the computer to utilise software, requiring inputs 
indicative of said characteristics, capable of changing the 
appearance of the imaged surface in accordance with user 
selection. 

15 According to the invention from another aspect there is 
provided a method of mapping a surface comprising the steps 
of : 

(a) temporarily attaching' a template device to the surface; 

(b) providing a photograph of said surface with the template 
2 0 device in situ; and 

(c) inputting a digital representation of said photograph to 
a computer provided with software capable, under user 
control, of changing the appearance of an image of the 
surface displayed thereby; 

25 the template device providing the computer with information 
defining one or more physical characteristics of said surface. 

Preferably the template device comprises a sheet carrying 
markings of known dimensions and at known relative 
30 orientations, thereby permitting .geometric characteristics 
of the surface to be accurately defined. 

It is further preferred that the said markings • include 
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components defining a rectangular frame with opposing sides 
being substantially parallel, thereby permitting the accurate 
derivation of perspective data for the surface as 
photographed- In such circumstances, . it is preferx:ed that the 
5 parallel sides be substantially aligned with perspective 
defining edges of said surface. 

It is further preferred that at least a portion of the 
template device is formed to reflect incident light to a 
10 predetermined extent, thereby permitting the derivation of 
suitable brightness data for the surf ace - 

The template device may further comprise a directional 
indicator to indicate the orientation of patterns or 
15 ornamentation incorporated by means of the software -into 
surface treatments to be displayed on the image of t said 
surface. 

In order that the invention may be clearly understood and 
20 readily carried into effect, one embodiment therepf will now 
be described, by way of example only, with reference to the 
accompanying drawings, of which: 

Figure 1 shows a part of a room, certain surfaces o:f which are 
25 desired to be imaged for the overlay by software of differing 
surface treatments, and to which surfaces are applied template 

devices in accordance with aspects of the invention; and 

> 

Figure 2 shows an image of the same part of the room with 
30 overlain treatment to some of said surfaces. 

As previously mentioned, the intention of the arrangement now 
to be described is to facilitate, speed up and render mare 
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accurate the input of data concerning the physical 
characteristics of substantially planar surfaces of a room or 
other area into a computer that is capable of running software 
that conditions the computer to display one or more of the 
5 surfaces overlain with selected surface treatments, A typical 
objective of the use of such expedients is to enable a home 
owner to review,, effectively in situ, various- potential 
surface treatments, such as paint colours, wallpaper designs 
and colours, carpeting and the like before redecorating, 
10 refurbishing or, indeed, before first decorating or furnishing 
a room. 

It is thus prerequisite that a computer is available to the 
user and that it is capable of running the software : that 
15 permits overlaying of colours, patterns and/or textures on 
surfaces displayed in an image of a room or other area derived 
from a photograph of the room or area- 

Ref erring now to Figure 1, a room 1 as viewed from a certain 
20 point includes parts of first and second walls 2 and 3, a 
floor 4 and a ceiling 5. Identical template devices 6, 7 and 
8 are temporarily applied respectively to the surfaces of 
walls 2 and 3 and floor 4; each template device comprising a 
sheet that bears markings conforming to a rectangular frame 
25 or outline 9 with opposing sides being parallel. The template 
devices 6 and 7 are orientated as shown, such that their 
respective rectangular frames 9 are disposed with two of their 
parallel sides aligned substantially parallel to the vertical 
edges of the respective walls and the other two parallel sides 
30 aligned substantially parallel to the horizontal edges of the 
walls. By this means, the perspective of the wall surfaces, 
as viewed in the photograph, can be derived, to an- acceptable 
degree of accuracy, by extrapolation from the well defined 
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edges of the frames on the template devices. The vanishing 
points, or intersection points of projected parallel lines on 
the surface subjected to the perspective of the photograph, 
constitute critical physical characteristics of the scene .as 
5 viewed and their location can, if desired, be improved by 
iteration or by other known techniques- 

* 

The markings such as 9 on the template devices are also 
constrained to be of known dimensions and thus provide an 
10 accurate basis for determination of other important physical 
characteristics, such as scaling and aspect ratio-. 

Usefully, the markings on the template devices can ..also 
' include orientation devices, such as the broad arrowsr 10, 
15 which can be used to indicate the orientation of a- pattern or 
ornament incorporated in a surface treatment tO; be 
synthetically overlain on a representation of the selected 
surface or surfaces. 

20 The sheet material of the template devices such as- 6 is- also, 
in this example, selected to have a known reflectance and 
colouration such that its in situ response to light falling 
on the surface to which it is (temporarily) applied can be 
utilised in applying suitable lighting characteristics to the 

25 imaged scene when selected overlays are applied to the 
surface. 

It will be appreciated that the computer which is running the 
overlay software needs to be suitable conditioned to 
30 automatically utilise the data derived from the template 
devices and relating to physical characteristics of the 
surfaces to develop appropriate measurands and operands, and 
additional software is supplied for that purpose.; 
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Figure 2 shows an image of the scene of Figure. 1^ with a 
surface treatment overlain on the walls 2 and 3; this being 
the desired object ive . 

5 It will thus be appreciated that, having decided which 
surfaces of a room are candidates for computerised texture 
variation, the user temporarily attaches a template device to 
each different plane of the surfaces to be mapped and takes 
a photograph of the room from a desired position.- 

10 

The photograph, unless taken on a digital camera, needs to be 
digitised (e.g. by scanning) for input to a computer running 
the required visualisation software, which guides the user 
through a sequence of operations designed to select the 

15 regions of the image corresponding to the surfaces in 
question, delineate the outline and mask out any features, 
such as doors and windows, which are not part of the planned 
review. The user is also requested, in each case, to identify 
the template device lying in the same plane as ^a selected 

20 outline. The computer evaluates the relevant physical 
characteristics, as described above, and the relevant textures 
can then be superimposed on the image of the scene as 
displayed, for example, on a screen associated with the 
computer . 

25 

The physical characteristics required by the texture-mapping 
software typically include vanish points (convergence points 
of extrapolated perspective lines) , calibration data for size 
mapping and aspect ratio, and area brightness. 

30 

These characteristics can, as mentioned - above, be generated 
by the computer from data derived from the template devices. 
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Regarding the vanish points^ the image of the template device 
is reviewed to identify the corner points of the rectangular 
frame 9 and these are used in pairs to extrapolate to the 
vanishing points for the relevant surface. It is preferred 
5 to hold these data with sub-pixel accuracy. 

L 

In one practical arrangement^ the following steps. are taken: 
a search window is localised on a point clicked by a user 

to identify the position of the template device; 
10 a sub-image is extracted from the main image-; 

an edge-detection algorithm is applied; 

pixel chainlists are extracted from the edge data using 
an algorithm that seeks to extract closed* shapes; 

corners are extracted from the chainlist data so as to 
15 identify squares and triangles within the template device; 
this being achieved in one example by taking account of 
maximum opening angle within the chainlist and the sum of the 
angles found at corners within the closed shape; ' ^l- 

real templates, as opposed to random shapes in the image, 
20 are identified; 

the corner points are individually labelled; ^ 

linear regression is used to move the corner points to 
optimise the line of fit to pixel data extracted during the 
edge detecting operation; 
25 the corner points are adjusted to take account of the 

direction of any arrowhead such as 10 included as a marking 
in the template device; and 

intersections to calculate the vanish points* are made. 



30 Bearing in mind that the user has supplied instructions to the 
computer defining a closed set of vector outlines for each 
planar element of each surface to be reviewed and an 
indication of the template device appropriate to each planar 
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element, the vanish points can be identified with higher 
accuracy, if desired, by: 

searching the list of outline segments for those that 
appear to project towards the provisional vanish point derived 
5 from the template data and excluding those that are short of, 
or within a set distance beyond, the boundary of the image 
frame ; 

using the retained outline segments to calculate the 
vanish point and the opening angle thereat; 

It 

10 selecting the pair of line segments that optimises the 

opening angle; and 

setting a new vanish point, specific to that mapping 
region, given by the intersection of the two selected lines. 

15 Once the vanish" points have been established to- a 'desired 
degree of accuracy, a mapping quadrilateral is .defined by 
using the two vanish points for a given planar element, 
finding the pair of intersecting lines for each that optimises 
the opening angle and computing the four points of 

20 intersection between these two pairs of lines - 

It is now possible to establish the 'true size of ' the 
quadrilateral; the first stage in this process being to call 
up the co-ordinates of the corners of the rectangular marking 

25 on the template device. If these are not contained within the 
dimensions of the mapping quadrilateral, the . latter is 
temporarily expanded to include them. Given the known 
dimensions of the markings on the template device- (e.g. 16cm 
sides, measured internally of the rectangle) a calibration 

30 factor giving the scale in each direction is established. It 
is then possible to map a texture to the quadrilateral. 

As mentioned previously, the template device can also be used 
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to determine scene brightness. The brightness is adjusted 
using the fact that white areas of the template have been lit 
by the ambient lighting conditions within the room. The 
brightness of pixels falling in the aforesaid white areas is 
5 compared to that of pixels in the immediate vicinity of the 
template device, but outside it, to ascertain the degree of 
adjustment needed to brighten scene pixels to the* same level 
as those representing the white areas of the template device. 

10 It will be appreciated that the template device can take many 
different forms and the scope of this invention is not 
intended to be limited to the specific example shown herein. 

device and 
processed 



Moreover, the information relating to the template 
its components may be derived differently. 



15 differently and utilised differently than described herein. 
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CLAIMS : 



1. A mapping arrangement for defining selected physical 
characteristics of a surface to be imaged^ the arrangement 
5 comprising a template device for temporary application to said 
surface; said template device being configured and constructed 
such that, when photographed in situ on said surface, it 
provides a computer supplied with a digital image of the 
photograph with data from which one or more of said physical 
10 characteristics can be automatically computed, thereby 
permitting the computer to utilise software, requiring inputs 
indicative of said characteristics, capable of changing the 
appearance of the imaged surface in accordance with user 
selection. - ^ - - - — . . - . 

15 

2. An arrangement according to claim 1 wherein the template 
device comprises a sheet carrying markings of known- dimensions 
and at known relative orientations, thereby permitting 



geometric characteristics of the surface to be 
20 defined. 



accurately 



2 wherein 



3. An arrangement according to claim 1 or claim" 
the said markings include components defining a rectangular 
frame with opposing sides being substantially^ parallel, 
25 thereby permitting the accurate derivation of perspective data 
for the surface. 



4 . An arrangement according to claim 3 wherein the parallel 
sides are substantially aligned with perspective defining 
30 edges of said surf ace . 



5 . An arrangement according to any preceding claim wherein 
at least a portion of the template device is formed to reflect 
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incident light to a predetermined extent, thereby permitting 
the derivation of suitable brightness data for the surface. 



6. An arrangement according to any preceding claim wherein 
5 the template device further comprises a directional indicator 
to indicate the orientation of patterns or ornamentation 
incorporated by means of the software into surface; treatments 
to be displayed on the image of said surface - 



10 7. An arrangement according to claim 6 wherein said 

directional indicator comprises a broad arrowhead; device. 



8. A mapping arrangement for defining selected physical 
characteristics of a surface to be imaged substantially as 

15 hereinbefore described with reference to and/or as shown in 
the accompanying drawings. 

9. A method of mapping a surface comprising the- steps .pf: 
(a) temporarily attaching a template device to the surf;^ce; 

20 (b) providing a photograph of said surface with the template 

device in situ; and 
(c) inputting a digital representation of said photograph to 
a computer provided with software capable, under user 
control, of changing the appearance of an image of the 
25 surface displayed thereby; 

the template device providing the computer with information 
defining one or more physical characteristics of sa;id surface. 
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